Planning a Career in Psychological Assessment

Free AccessPlanning a Career in Psychological AssessmentLessons Learned From the EAPA Winter School 2021Kay Brauer, René T. Proyer, Samuel Greiff, Anna Brown, Fabian Gander, Johann-Christoph Münscher, Anu Realo, Diego Rivera, Jérôme Rossier, and Lisa WagnerKay BrauerKay Department of Psychology, Martin Luther University Halle-Wittenberg, Emil-Abderhalden-Str. 26-27, 06108 Halle, Germany, E-mail [email protected] Germany Search for more papers by this author, Proyer Greiff Behavioural Cognitive Sciences, Luxembourg, Luxembourg Brown Kent, United Kingdom Gander Zurich, Switzerland Münscher Helmut Schmidt University, Hamburg, Realo Warwick, Institute Tartu, Estonia Rivera Health Public Navarre, Spain Rossier Lausanne, Wagner authorPublished Online:July 30, 2021https://doi.org/10.1027/1015-5759/a000666PDF ToolsAdd to favoritesDownload CitationsTrack Citations ShareShare onFacebookTwitterLinkedInRedditE-Mail SectionsMoreTwo aims that are explicitly formulated mission statement European Association Assessment (EAPA) “promote interest young professionals scientists science psychological assessment” “create opportunities scientific exchange about (EAPA, 2021). In an effort address these goals, held its first-ever School1 bringing early career researchers (ECRs) experts together. The school was hosted Halle-Wittenberg on May 7, 2021 (online due pandemic situation). Editorial, we highlight some issues discussed, advice concerns expressed what consider when planning assessment. While cannot be comprehensive guide, it should seen as starting point extensive discussion aimed at helping emerging scholars field. Of note, Journal Assessment, EJPA, flagship journal EAPA, often receives submissions from ECRs (as first authors) shares EAPA’s commitment toward supporting them through high-quality swift review processes. We hope Editorial helps serve additional building block beginning their career.Thinking Big, Being Innovative, Planning Ahead being Employed Short-Term ContractECRs face paradoxical situation: They expected “think big” new research projects, innovative, follow long-term plan (e.g., establishing longitudinal study), important societal while working short-term or temporary contracts offer little guarantees future. Also, there is pressure publish work high numbers quality. do all while, among other things, improving one’s writing skills, attending conferences, networking, grant applications (and frequently also having manage teaching advanced level supervising undergraduate students) – not speak life outside academia (just thought: How one think family with uncertainties around?)! Hence, consideration how balance smaller larger projects publication strategies. assessment, can range basic works test adaptations, improvement revisions existing measures, creation norms contributions methodological name but few. Working team good mentors will help making decisions select publishable material, combine findings produce impactful publications contribute knowledge researcher’s profile.Of course, “thinking investment. innovative resolve bigger networking efforts, increase chances get funding, enable follow-up research. so-called “replication crisis,” which has hit psychology particularly hard (or least first, disciplines yet have re-evaluate practices; e.g., Shrout & Rodgers, 2018), shown merit replicating extending work. It seems merits latter better understood field Most specialized journals require evidence stability replicability cross validation second, independently collected sample). Taken together, portfolio covers applied around development evaluation, attempting solve theoretical complex questions fundament short, recommendation “put eggs basket” trying parallel minimize risk depending success single study project important. welcome hiring committees re-evaluating current standards rating quality applicant higher than mere number) considering factors such innovativeness future-mindedness strongly. Such practices would probably encourage take risks ideas, rather re-iterating been successful others.DiversifyingTenure track positions (full) professorships dedicated assessment comparatively rare. For example, German Association’s (DGPs) chapter personality, individual differences, hosts list chairs German-speaking countries field; 2021, only 7 out 108 university specifically others combined adjacent disciplines, mostly personality educational psychology, organizational counseling psychology. candidates demonstrate expertise (typically via publications) another (substantive) eligible candidate chair Experts’ experiences converged academic home country.ECRs need diversify areas, methods they use This notion familiar those used pursuing multi-method approaches know limitations mono-method approach. Although, most develop preferences certain approaches, make sure repetition once established analysis method.Theory MattersA shared concern measures sometimes lack justification nomological net somewhat under-developed. is, fact, issue report tools received EJPA. could argue readership might primarily interested technical details analyses findings, desire information background constructs assessed. Providing background, prior empirical net, distinctions previously instruments important, because components provide (a) potentially measure, (b) no redundancy (c) wasted resources terms time takers alike (see Ziegler, 2020). Publishing routinely improve understanding assessed prevent occurrence jingle-jangle fallacies presenting old wine bottles Condon et al., 2020; Ponnock Additionally, makes easier interpret substantively. addition needs balanced word counts reported, repositories electronic supplementary materials ample space moving parts manuscript may less central main aim.Mentoring (Scientific) AutonomyWhen comes planning, mentoring process key. Establishing postdocs Summer PhD students initiatives set emphasis support regard. encouraged professional contacts, networks, engage actively mentors, peers, opportunities. Here, initial that, hopefully, results efforts. regard, already resulted promising contacts enhanced ECRs. challenges mentioned earlier remedied using senior acting letting junior members conducted lab. However, autonomy visibility done co-authors head lab build own network well finding niche, becoming expert topic. well-suited find open questions, whether studying Situational Judgment Tests data), considerations factor analytic takers’ responses, providing specific broad general intelligence; big five traits) narrow attention; cognition) differences variables testing differential assessing self- informant reports; behavioral traces Smartphone data; non-verbal tasks), approaches’ reliability validity. There research; decision reports ways norming seem fields further work.Know Your Methods More)Psychological strong roots data expertise. collecting analyzing progressing rapidly, rise “big data” artificial intelligence machine learning Cheung Jak, 2018; Harari Interestingly, recent sentiment psychologists’ Twitter accounts showed increasing topics “Data Science,” “Artificial Intelligence,” “Machine Learning” whereas traditional validity “classical” psychometric analyses) did emerge “hot topics” (Bittermann must noted come respect ethical protection consent usage units) warrant broader Favaretto Despite bring, weighed against potential gain. Without pointing approach, learn programming, keep your finger pulse methods. Combining integrating modes sources meaningful way types advantage. many large-scale panel currently exist give opportunity conduct secondary program. fancy method alleviate weak design, psychometrically unsound instruments, biased sampling available (i.e., sake), without does add generation knowledge. Therefore, our recommend crafting basics analyses, interpretation approaches.Embrace Transparency Open ScienceThe replication crisis affected publishing similarly regard efforts transparent. both outlets EJPA Test Adaptation Development PTAD) neighbor Personality Psychology’s Science) implemented promoted transparency published studies (Back, 2019; Allen, Rauthmann, initiative requires authors data, codes syntaxes, openly independent Science Framework). particular, three pillars movement; namely, raw syntaxes/codes), questionnaires, instructions, clarifying experimental software), pre-registration stating hypotheses before analysis, optimally collection, begins). These strategies increased researchers’ endeavors replicate extend measurement invariance between language adaptations same measure comparing newly data). limiting factors, copyrighted made available, participants’ sensitive personal protected allow identification participants email IP addresses), missing priori pre-registrations considered estimates fit indices introduced instruments?). registered reports, submit proposal including rationale plans, community visible output Mehlenbacher, 2019), observed journals. active engagement increasingly universities applicants professorships. highly recommended reproducibility field.Learn Communicate PractitionersPsychological strongly tied practical ensure developed revised meet demands practitioners. Learning so ease, write manuals users, useful interpretations key communication practice inform practitioners areas needed. Ensuring mutual allows practice-friendly solving “real world-problems.” feedbacks application form adults only, importance adolescents target groups). Finally, special groups even close collaboration, met cases.Aside work, always mind applications. in, expanding normative sample generating analyses.ConclusionThe wishes involved researchers. By organizing winter/summer schools hopes access international forum skills network. alongside whole discipline changed rapidly past decades will, continue trajectory replicability). goes along restrictions predictability outcomes any recommendations future based limitations. Nonetheless, embracing developments regarding transparency, advances, etc.), keeping multi-methodology, focus validity) aspiring ability assess individuals, evolutions interactions contexts remain crucial science. Our societies challenges, inputs advice. challenge lowering ecological footprint, able assess, follow, document human behavior crucial. participation socially future.Experts participating 1st honorarium paid “Hogrefe.” grateful financial realizing event.1Skepticism holding alleviated: temperature Halle 6 degrees Celsius suitable ambience rightfully call School.References Back, M. D. (2019). Increasing Personality, 33(1), 3–6. https://doi.org/10.1002/per.2192 First citation articleCrossref, Google Scholar Bittermann, A., Batzdorfer, V., Müller, S. M., Steinmetz, H. (2021). Mining detect hotspots Zeitschrift für Psychologie, 229(1), 3–14. https://doi.org/10.1027/2151-2604/a000437 articleLink, Cheung, W.-L., (2018). Challenges 226(4), 209–211. https://doi.org/10.1027/2151-2604/a000348 Condon, Wood, D., Mõttus, R., Booth, T., Costantini, G., S., Johnson, W., Lukaszewski, Murray, Revelle, Wright, A. G. C., Zimmermann, J. (2020). Bottom up construction taxonomy. 36(6), 923–934. https://doi.org/10.1027/1015-5759/a000626 Favaretto, De Clercq, E., Gaab, J., Elger, B. harm: An exploration ethics Big Data studies. PLoS One, 15(11), Article e0241865. https://doi.org/10.1371/journal.pone.0241865 EAPA. (2021, 1). mission. https://www.eapa.science/about-eapa/our-mission articleGoogle introduces submission format. 34(4), 217–219. https://doi.org/10.1027/1015-5759/a000492 Van der Westhuizen, L., Mund, F., Wetzel, E. Introducing 36(5), 717–720. https://doi.org/10.1027/1015-5759/a000628 Harari, Vaid, Stachl, Marrero, Z., Schoedel, Bühner, Gosling, sensing theory digital age. 34(5), 649–669. https://doi.org/10.1002/per.2273 R. Registered reports: Genre evolution article. Written Communication, 36(1), 38–67. https://doi.org/10.1177/0741088318804534 Ponnock, Muenks, K., Morell, Yang, Gladstone, Wigfield, Grit conscientiousness: Another jangle fallacy. Research 89, 104021. https://doi.org/10.1016/j.jrp.2020.104021 F. science: Unified diversity. Science, 1(1), e5297. https://doi.org/10.5964/ps.5297 Shrout, P. L. science, construction: Broadening perspectives crisis. Annual Review 69, 487–510. https://doi.org/10.1146/annurev-psych-122216-011845 adaptation structured why. Development, 1, 1–9. https://doi.org/10.1027/2698-1866/a000002 ScholarFiguresReferencesRelatedDetails Volume 37Issue 4July 2021ISSN: 1015-5759eISSN: 2151-2426 Published onlineJuly InformationEuropean (2021), 37, pp. 261-265 https://doi.org/10.1027/1015-5759/a000666.© 2021Hogrefe PublishingAcknowledgments:Experts event.